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AN APPARATUS AND METHOD FOR ESTIMATING REFLECTED 
RADIANCE UNDER COMPLEX DISTANT ILLUMINATION 

FIELD 

[0001] One or more embodiments of the invention relate generally to the field of 

computer graphics, specifically global illumination. More particularly, one or more of 
the embodiments of the invention relates to a method and apparatus for estimating 
reflected radiance under complex distant illumination. 

BACKGROUND 

[0002] In computer graphics rendering is a process of generating digital data that 

represents the projection of a three dimensional scene onto a two dimensional image 
plane in order to simulate the recording of the scene by, for example, a camera. The 
digital data generally represents the projection of surfaces of objects in a three 
dimensional scene, illuminated by one or more light sources, onto the two dimensional 
image plane. The two dimensional image is in the form of an array of picture elements 
(pixels). The rendering process may utilize a geometric model that specifies the position, 
shape and color of objects and light sources in a world space. 

[0003] One approach to rendering is a two stage process comprised of a geometry 

stage and a rendering stage. In the geometry stage a data base of geometric descriptions 
of objects and light sources (the geometric model) is transformed from a world coordinate 
system (object space) into a view dependent coordinate system (screen space) taking into 
account a view point and view surface. The view point is a point in the object space from 
where the objects are being viewed to obtain the image. The view surface is the surface 
in the world space that corresponds to the screen space. 

[0004] In the rendering stage, once the positions of the objects and the screen 

space are determined, each pixel is colored (assigned a color comprised of, typically, non- 
negative red, green, and blue values) depending on which objects are occluded or visible. 
Accordingly, color rendering is performed by determining which objects are visible from 
the view point within the bounds of the view surface and then determining the color of 
the light that is emitted or reflected from the visible objects in the direction of the view 
point. 

[0005] A common rendering task in feature film visual effects is to integrate 

computer generated elements with a live action background. The computer generated 
(CG) elements or models range from organic characters animated via complex physical 
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models to static objects like buildings or vehicles. Often, all of the light in the scene 
emanates from outside the object, and the object passively reflects incident radiance 
toward the camera. This process, called Image-based lighting (IBL), involves 
illuminating the CG elements (scene database) with images of light from the real world. 
IBL evolved from a reflection mapping technique in which panoramic images are used to 
texture maps on computer graphics models to show objects reflecting real or synthetic 
environments. In practice, these IBL renderings are frequently achieved using a number 
of heuristic techniques, mostly requiring labor intensive setup and tweaking by digital 
artists. 

[0006] As computers get faster and global illumination algorithms improve, there 

is an increasing desire to calculate such "outside-in" image-based lighting situations 
using global illumination. One step in many global illumination algorithms is to 
compute, at a surface point, the radiance reflected toward some direction due to direct 
illumination (i.e., photons that have traveled directly from the light source to the surface, 
without having been reflected in between). 

[0007] Generally, the contributions of the light reflected from the various surfaces 

in a scene to a pixel's value (representing the color and intensity of that pixel) are 
expressed in the form of one or more integrals equations, for example the Kajiya 
Rendering Equation. In particular, the reflected radiance integral describes the amount of 
light energy (radiance) reflected directly from a light source to a pixel's location on the 
view surface. This is the fundamental quantity that physically-based computer graphics 
rendering algorithms compute. 

[0008] The integrand of the reflected radiance integral is the product of three 

functions, L,f n and V p9 where L depends on the position, intensity, and output 
characteristics of light sources,/, (the bi-directional reflectance distribution function, or 
BRDF) depends on reflectance properties of the scene surfaces, and V p (the visibility 
function) depends on the geometry of the scene. Since the reflected radiance integral will 
generally not have a closed form solution, numerical methods are used to evaluate it in 
order to generate pixel values. Typically, exact Monte Carlo methods or approximate 
methods have been used in computer graphics to numerically evaluate the reflected 
radiance. 

[0009] Approximate methods are usually very fast but compute only an 

approximate value for reflected radiance. Therefore, they usually require significant 
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additional hand tuning in order to obtain a visually realistic final rendered image. Exact 
algorithms have the property that if the algorithm runs for a long time, it is guaranteed to 
eventually yield arbitrarily low error. In other words, exact algorithms eventually 
converge to the correct solution, whereas this is not necessarily true for approximate 
algorithms. For this reason, exact algorithms are often preferred for high-end computer 
graphics applications. The most common exact method for computing reflected radiance 
under an environment map light source is Monte Carlo or Quasi-Monte Carlo BRDF 
weighted importance sampling. 

[0010] In general, importance sampling estimates the value of an integral by 

sampling the integrand where it is likely to have the most energy, as specified by an 
importance function. In BRDF importance sampling, hemispherical samples are chosen 
relative to an importance function that weighs a particular direction of the hemisphere 
proportional to the value of the BRDF in that direction. For example, \zlf£(D,n y Q) r ) be a 
BRDF that measures the amount of energy scattered from direction co to direction co f at 
surface point p with normal n. To evaluate reflected radiance in direction co from surface 
point p with surface BKDFf r (CQ f n,a) r ), the importance function I(co r ) is chosen 
proportional to fjco,n,(0 r ) (since n and co are fixed, this is a function of co"). 
[0011] When/ r is a Lambertian or Phong BRDF, methods exist for transforming 

samples drawn uniformly from the unit square into samples drawn according this 
importance function over the hemisphere. Samples over the unit square are drawn using 
independent uniform sampling, stratified sampling, or a Quasi-Monte Carlo low- 
discrepancy point sequence (such as the Halton sequence). These sample points are 
transformed to the hemisphere, and the resulting hemispherical directions are used as 
sample points in the standard importance-sampling estimator, weighted inversely 
proportional to the importance function l(co T ). 

[0012] Unfortunately, the method of BRDF-based importance sampling used to 

evaluate the reflected radiance integrals has sub-optimal efficiency. This is because light 
source output L and scene visibility V p may contribute significant energy to the reflected 
radiance integrand, but are ignored when placing random samples according to only the 
BRDF. When applied to complex real-world lighting situations, such as, for example, 
image-based lighting, BRDF-weighted importance sampling often misses the important 
features of the integrand and hence will require an enormous number of samples in order 
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to compute an accurate image. Alternate importance sampling techniques take the light 
source L into account when placing samples, but ignore the effects of the scene visibility 
V p and surface reflectance f r 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] The various embodiments of the present invention are illustrated by way 

of example, and not by way of limitation, in the figures of the accompanying drawings 
and in which: 

[0014] FIG. 1 is a block diagram illustrating reflected radiance of a point in an 

object space illuminated by a light source. 

[0015] FIG. 2 is a block diagram illustrating a bi-directional radiance distribution 

function (scattering ratio) experienced at a camera based on a direction o and an I/O ray 
between the point and the camera. 

[0016] FIG. 3 is a block diagram illustrating a sphere of incident illumination for 

image-based lighting, as known in the art. 

[0017] FIG. 4 is a flow chart illustrating a method for image rendering utilizing a 

reduced number of hemispherical samples to estimate the reflected radiance integral, in 
accordance with one embodiment of the invention. 

[0018] FIG. 5A is a picture illustrating a "grace" environment, a known 

benchmark for testing computer graphics applications. 

[0019] FIG. 5B is a photograph illustrating ray samples, in accordance with an 

embodiment of the invention for a reflected radiance calculation of the "grace" 
environment, as depicted in FIG. 5A. 

[0020] FIGS. 6A-6C are block diagrams illustrating tessellation of a spherical 

environment map, in accordance with one embodiment of the invention. 
[0021] FIG. 6D is a graph illustrating results for estimation of the reflected 

variance integral. 

[0022] FIG. 7 is a block diagram illustrating mapping of a value from a unit 

square to a hemisphere, according to the weight of each spherical triangle, in accordance 
with one embodiment of the invention. 

[0023] FIG. 8 is a flow chart illustrating a method for shading a point utilizing a 

reduced number of hemispherical samples to estimate the reflected radiance integral, in 
accordance with one embodiment of the invention. 

[0024] FIG. 9 is a flow chart illustrating a method for shading a point utilizing a 

reduced number of hemispherical samples to estimate the reflected radiance integral, in 
accordance with a further embodiment of the invention. 
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[0025] FIGS. 10A-10C are drawings illustrating an occlusion image for 

determining visibility, in accordance with one embodiment of the invention. 
[0026] FIG. 11 is a block diagram illustrating a computer system including render 

logic for estimating a reflected radiance integral under complex distant illumination in 
accordance with one embodiment of the invention. 

[0027] FIG. 12 is a block diagram further illustrating render logic, as depicted in 

FIG. 11, in accordance with a further embodiment of the invention. 
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DETAILED DESCRIPTION 
[0028] A method and apparatus for estimating reflected radiance under complex 

distant illumination are described. In one embodiment, the method includes estimating 
reflected radiance under complex distant illumination, such as image-based lighting 
(IBL). Accordingly, a reflected radiance integral is efficiently computed in the case 
where incident light has a high variation as found in real-world lighting situations, such 
as outdoors or on a cinematic set. In one embodiment, an unbiased Monte Carlo 
technique is provided for estimating the value of reflected radiance at a surface point due 
to a hemisphere of direct distant illumination. 

[0029] In one embodiment, an importance sampling estimator is used with a novel 

piecewise constant importance function that effectively concentrates ray samples where 
energy is likely to be found. To properly account for the effects of a visibility term in the 
reflected radiance calculation, in one embodiment, a shadow cache is provided which 
caches information indicating ray directions that are occluded or unoccluded from a point 
in space. Accordingly, by concentrating hemispheric samples where the light source is 
likely to be strongest, a reflected radiance integral is efficiently computed and estimated 
in a real-world lighting situation. In one embodiment, the described techniques are 
implemented in a shader of an offline rendering system. 

[0030] In the following description, certain terminology is used to describe 

features of the invention. For example, the term "logic" is representative of hardware 
and/or software configured to perform one or more functions. For instance, examples of 
"hardware" include, but are not limited or restricted to, an integrated circuit, a finite state 
machine or even combinatorial logical. The integrated circuit may take the form of a 
processor such as a microprocessor, application specific integrated circuit, a digital signal 
processor, a micro-controller, or the like. 

[0031] An example of "software" includes executable code in the form of an 

application, an applet, a routine or even a series of instructions. The software may be 

stored in any type of computer or machine readable medium such as a programmable 

electronic circuit, a semiconductor memory device inclusive of volatile memory (e.g., 

random access memory, etc.) and/or non-volatile memory (e.g., any type of read-only 

memory "ROM," flash memory), a floppy diskette, an optical disk (e.g., compact disk or 

digital video disk "DVD"), a hard drive disk, tape, or the like. In one embodiment, the 

present invention may be provided as an article of manufacture which may include the 
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machine or computer-readable medium having stored thereon instructions which may be 
used to program a computer (or other electronic devices) to perform a process according 
to one embodiment of the present invention. 

[0032] FIG. 1 is a block diagram illustrating an area light source (LS) 100 that 

subtends a solid angle omega (Q) whose radiance output at a particular wavelength is 
characterized by the function L(p,co). The function L(p,co) is a function of a point in 
space p 1 12 of an object 110 and a direction (0 120. For a particular surface point p 1 12, 
with normal n 130 and a ray to the virtual camera e (the "eye" ray) 140, the reflected 
radiance from p 1 12 along e 140 due to the light source 100 can be expressed by the 
following reflected radiance integral: 

I(p,n y e)=\ L(p,co)f r (co,n,e)Vp(co)dco (1) 

By convention, the differential measure dco is sometimes taken as subtended solid angle 
multiplied by the cosine of the angle between the normal n and the variable of integration 
co, computed as n-co. In the description below, however, dco is simply subtended solid 
angle, and the cosine term n-co will be included in the BRDF function, f r 
[0033] Within Equation (l)f r is a Bi-directional reflectance distribution function 

(BRDF) 200 that describes how light is scattered from direction co 220 to e 240 with 
surface normal n 230. For example, as depicted in FIG, 2, a surface 202 with surface 
normal n 230 includes a camera 250 with an "eye" ray (e) 240 in one location, as well as 
plurality of incoming incident light rays according to various directions co 222. As such, 
the Bi-directional reflectance distribution function 200 provides a value of the energy 
(radiance) reflected toward the camera 250 (i.e., based on the angle of the incident light 
co). The V p term of Equation (1) is a visibility function with a value of 0 if p 1 12 is 
occluded from the light source 100 in the direction 0) and 1 otherwise (see FIG. 1). 
[0034] As depicted in FIG. 3, in image-based lighting (IBL), a sphere of incident 

illumination 300 is used as a light source to illuminate a synthetic object. (Typically, this 
sphere of incident illumination 300, called an environment map, is captured with a 
panoramic camera using high-dynamic range photography techniques.) Some rendering 
algorithm is then used to render the appearance of the synthetic object illuminated by the 
panoramic light source. The algorithm computes, at a surface point 310, the radiance 
(light energy) reflected towards some direction due to direct illumination (i.e., photons 
that have traveled directly from the light source to the surface, without having been 
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reflected in between), as depicted in FIG. 1. The computation of this quantity involves 
calculating the value of an integral that is commonly referred to as the "reflected radiance 
integral" (Equation (1)). 

[0035] In one embodiment, the integrand of Equation (1) is referred to as H pn e 

with Equation (1) rewritten as: 

I(p,n,e)= f H P , ne {(D)d(D. (2) 

As described herein, H is referred to as a "hemispherical transfer function", of units 
Watt/mVsr 1 , or radiance per solid angle. 

[0036] In IBL, a light source is considered as positioned at the sphere at infinity. 

As a result, luminance provided the function L(p,co) depends on the direction (0, such that 
the parameter p may be dropped from Equation (1). In one embodiment, the light source 
given by the function L(co) is derived from measured data captured with a panoramic 
camera or radiance sensor. Once captured, the values of L(co) are stored in an 
environment map. As described herein, the function L is described in an image-based 
lighting sense. Furthermore, the integral of Equation (1) is evaluated over the entire 
hemisphere 170 centered about surface normal n 130 (denoted by £2„ or simply £2), as 
depicted in FIG. 1. 

[0037] The overriding cost of evaluating Equation (1) is testing the visibility term 

V p , which typically requires casting a ray into the scene for each angle to or ray sample. 
As known to those skilled in the art, ray tracing (also known an as "ray casting") is 
performed to determine the visibility of surfaces by tracing imaginary rays of light from 
the viewer's eye to the object seen, for example, as depicted in FIG. 1. Accordingly, ray 
casting is performed for each ray sample by casting a ray in each direction co from 
point p. 

[0038] In one embodiment, the number of times required to test the visibility term 

is minimized by reducing the number of hemispherical samples required to estimate 
Equation (1) with low noise and high accuracy. While it may be possible to use finite 
quadrature rules to estimate integrals, in one embodiment, Monte Carlo (MC). Quasi- 
Monte Carlo (QMC), or Randomized Quasi-Monte Carlo (R-QMC) methods are utilized 
to provide accuracy and flexibility. In one embodiment, the importance sampling 
technique described in further detail below provides effective results for as few as, for 
example, 128 hemispherical samples, even in a highly dynamic lighting environment. 
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[0039] FIG. 4 is a flow chart illustrating a method 400 for image rendering 

utilizing a reduced number of hemispherical samples to estimate the reflected radiance 
integral in accordance with one embodiment of the invention. As described in further 
detail below, the method 400 may be optimized by factoring as much as possible out of 
the inner loops. In one embodiment, this is performed by decreasing the required number 
of hemispherical samples, while providing efficient image quality. As a result, process 
blocks 440 and 450 (shading/color calculation) are performed fewer times, as compared 
to conventional techniques, without sacrificing rendered image quality. In one 
embodiment, given an environment map (L(co)), precomputation as described below is 
performed, which may take approximately twenty minutes depending upon quality 
settings. 

[0040] Importance sampling is an unbiased Monte Carlo technique that succeeds 

by placing more samples where the integrand has more energy. As known to those 
skilled in the art, the Monte Carlo technique provides a means for evaluating an integral 
for which a closed form solution does not exist by sampling the integral at random points. 
For example, given a function f over domain D, to estimate the integral 

/=f f(x)dju(x) (3) 

Jx&D 

using importance sampling, a function p(x) is required such that samples can be drawn 
from domain D according to a probability density function (PDF) that is easy to calculate 
at any point in the domain D. For example, given N samples drawn from the domain D 
according to PDF p(x), the importance sample estimator of Equation (3) is 

i P , N =±-± m.. 

p(x,) 

Defining the residual r(x) = f(x) - Ip(x), t pN is a random variable, and its variance is given 
by the equation 

vaAuuU (4) 

From this Equation, it is apparent that when the importance function p(x) is exactly 
proportion to the integrand f(x), the variance of this estimator is zero. In general, the 
more closely p(x) is proportional tof(x), the lower the variance of this estimator, allowing 
this estimator to quickly converge to an acceptable result. 
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[0041] Although importance sampling is used to estimate the reflected radiance 

integral, the various techniques are limited to estimation of the BRDF or f r and ignore the 
incident radiance function L(co) (light source form) and visibility V p term of Equation (1). 
Although conventional techniques works well for uniform area light sources, these 
techniques are ineffective in IBL situations. In contrast to conventional techniques, the 
new importance sampling estimation of the reflected radiance integral matches all the 
features in the hemispherical transfer function H pne . ("#" function or H) (See Equations 
d)and (2).) 

[0042] Prior techniques are unable to provide the importance sampling estimation 

according to embodiments of the invention, since it is often difficult to select an 
importance function from which samples are easily drawn. In addition, the H function 
(H pne ) is different for each point p because the visibility function V p changes with p. 
Accordingly, one embodiment of the invention, uses a piecewise-constant approximation 
to the H function that can be rapidly computed and sampled. In a further embodiment, a 
shadow cache is used to estimate the value of the visibility term V p , based on nearby 
surface samples, which can then be combined with the piecewise-constant importance 
function to yield an efficient importance sampling scheme. 

[0043] In one embodiment, H is split into a sum of several functions, each with 

M 

small support. Let {77}- — - be a partition of the unit hemisphere Q n , such that 

T;P| Ti * 0 => i = j and (Jt— 7* = Q« , for example: 

M 
i=l 

where Xt&®>) is the indicator function over region T { that is 1 when coeT, and 0 otherwise. 
In the Lambertian case (diffuse reflection), the equation expands to 

M 

Ex7;-H^H(con)y p (o)) 

[0044] If a region T t is small enough, the value of His approximated over T,as a 

constant function whose value is the average of H over 7^. Thus we have 

i=l ' Area{Ti) 
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where Area (T t ) is the surface area of the region T x and 0 is a dummy variable of 
integration. Ignoring the visibility term V p , the integral in the numerator can be 
interpreted as the response of the environment map defined by L(0)x T i( 6) under the 
Lambertian BRDF with normal n. In one embodiment an ambient occlusion 
approximation is used to approximate the visibility term's contribution with the average 
occlusion over the region T r In other words, let 

A(P)= Area{T) (6) 



which gives a value A/pje [0,1]. In one embodiment the term A t {p) is an approximated 
with the estimate AJp). Improving the accuracy of the estimate A t (p) decreases the 
variance of an importance estimator of Equation (1), but to make the estimator unbiased 

requires A//?)> 0 when A t {p)> 0. A piecewise-constant approximation to //, denoted His, 

for example, 

h,»=2*» — Area(T) ro 

A A 

where H is constant over each region T t . Like H, H varies with the point p and the 
normal n. 

[0045] In the above description, the BRDF is assumed to be Lambertian. In 

general, many standard BRDF functions can be parameterized by a single vector, called 
the free parameter of the BRDF. A Phong BRDF, for example, can be parameterized by 

A 

only the reflection vector r. If the BRDF/ r can be expressed this way, //will vary with 

point p and the free parameter vector. Then the above derivation may be repeated with 
the expression for the BRDF as a function of free parameter, e.g., the Phong BRDF fj(r,0) 
replacing the Lambertian BRDF/ r (n,0) = (0-n), yielding an alternate form of 
Equation (7): 

' w Area(T,) 

[0046] FIG. 5A illustrates a two-dimensional representation of an environmental 

map 500 generated in response to the grace cathedral (grace environment), a known 
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benchmark for testing computer graphics applications. In response to the grace 
environment with a Lambertian BRDF, the new importance sampling function (Equation 
(5)), generates ray samples in the areas of greatest illumination of the grace environment, 
as depicted in FIG. 5B. Although 1,000 ray samples are illustrated, in the embodiments 
described below, a reduced number of ray samples can be used as co to computer the color 
value for a surface point. Accordingly, computation of the unoccluded contribution of 
surface point P at pixel PEL (shading/coloring) of process block 450 is performed for 
each ray sample co. 

[0047] Accordingly, by focusing the ray samples into areas that have the highest 

concentration of illumination, the new importance sampling function converges much 
faster than conventional BRDF-based importance sampling because the importance 
function matches the integrand more closely. In other words, utilizing importance 
sampling, in accordance with embodiments of the invention, the ray samples are 
concentrated over the brightest light sources even though they subtend a small solid 
angle, as depicted in FIG. 5B. 

[0048] In one embodiment, for the Lambertian case, Equation (3) is used with 

A 

H pn as the importance function, .Qn as the domain, and H pn as the integrand. In one 

A 

embodiment, H pn is efficiently evaluated at each pixel to enable drawing of samples 

A 

from Q. n according to the distribution H pn along the unit hemisphere. 

A 

[0049] The approximation H p n depends on a particular partition of the 

hemisphere centered around n. Because n may change with every pixel, in one 

A 

embodiment we generate a suitable partition on-the-fly, and compute H pn over each of 

the regions in this partition. For example, environment map 500 represents a two- 
dimensional map of a 360° image of the grace environment. A three-dimensional 
environment map of the grace environment is illustrated in FIG. 6A. As illustrated, 
environment map sphere 520 is partitioned into M spherical triangles. 

M 

[0050] For example, let {77}- — - be a fixed tessellation of the sphere 520 into, 

for example, M spherical triangles. In an alternative embodiment, a two-dimension 
environment map is tessellated into M-regions. One embodiment for generating a 
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tessellation given the environment map 520 is described in further detail below. As a 
precomputation step, performed once per environment map for each spherical triangle 7^, 
in one embodiment, in the case when he surface is Lambertian, a diffuse convolution of 
% Ti L, is computed as: 

',(») = / ..r, (Xt, (co)L(w)(co ■ n)d(o) (8) 
[0051] In one embodiment, the results are stored in a texture map indexed by 

surface normal n. A polar coordinate parameterization of the /, map at, for example, a 
32x64 resolution may be provided. (Generally, higher resolutions do make any 
difference in rendering quality.) The running time for precomputation of the texture map 
is a proportional to M. For a different BRDF function, the convolution is computed and 
stored in a map parameterized by the BRDF free parameter. 

[0052] In the inner loop of a rendering algorithm (process block 450 FIG. 4), an 

estimate of the reflected radiance at point p with normal n is required. In one 

A 

embodiment, a tessellation of Sl n is generated and the values of H pn are computed over 
each spherical triangle in this tessellation as follows. First, a weight W, is computed for 

A 

each triangle T t in the fixed tessellation, Wf=I£n)Aj[p). I^n) is precomputed and stored in 

A 

a map. One embodiment for computing A { (p) is discussed in further detail below. 
[0053] In one embodiment the tessellation of the hemisphere 530 about n 534 is 

adjusted by a "clipping" procedure, where each triangle is clipped against £2„to generate a 
visible triangle list as depicted in FIG. 6B. In other words, the tessellation sphere 520 is 
split into a hemisphere 530 of point P 532 with surface normal (n) 534, such that triangles 
below the horizon of the hemisphere 540 are disregarded and triangles that lie in both 
hemispheres are split. The algorithm for spherical triangle clipping is given in Appendix 
A. The result of clipping a triangle against the hemisphere is that either the entire triangle 
is outside the hemisphere 530, in which case it is not included in the visible list, the entire 
triangle is inside the hemisphere, in which case it is included in the visible list 
unmodified, or the triangle is partially inside the hemisphere, in which case the triangle is 
split. 

[0054] As described in Appendix A, the portion of a partially clipped triangle 7^ 

that overlaps £2 n can be expressed as either a smaller triangle J 1 ) » or the union of two 
smaller non-overlapping triangles T) and J 1 *. In the case that a single triangle is 
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produced, T) ( but not T d is included in the visible list with weight to W ( . In the case that 



two triangles are produced, the weight is split proportional to the areas of the two result 
triangles, 



and J 1 ) and T] are included in the visible list (but not T t ). The list of visible triangles is 

A 

a partition of £l„, and the value of H over a visible triangle T ( is equal to the triangle's 
weight Wt divided by its area, Area (T t ). 



ratio of the squared residual to the importance function. Thus a high variance exists when 
the residual is high relative to the estimated importance. In general, the variance of an 
estimator is high when L((D)fX0) 9 n f (O 9 )V p ( co) varies over the area of the triangle. Because 
//to,n,&>'J and V p (co) depend on n and p, there is no way to take them into account when 
devising the fixed tessellation of the sphere. In one embodiment, the residual error is 
reduced by minimizing the variation of L((o) over each triangle by more finely 
tessellation regions 642 of the sphere 640 where variance of L(a>) is greatest for example 
as depicted in FIG. 6C. 

[0056] In a further embodiment, a greedy algorithm is used to generate adaptive 

triangulations of the sphere 640. Initially an icosahedron, which has 20 triangles, is 
subdivided a minimum number of times (a minimum level of three works well). All 
triangles are placed in a heap sorted in decreasing order by the variance of the 
environment map L(co) over the region of that triangle. Given a triangle budget M, the 
first triangle from the heap (which will have the largest variance) is iteratively removed . 
If the subdivision level is below a user threshold, the triangle is subdivided once, and the 
four new child triangles are placed back on the heap. The process halts when there are M 
total triangles. 

[0057] M is a quality setting that may be set quite high without adversely 

affecting rendering times. In practice, a scene as depicted in FIG. 5A, is rendered at 
10,000 samples per pixel as a baseline. The scene is then rendered with different values 
of M (x - axis) at, for example, 165 samples per pixel, and the L 2 distance (y - axis) is 
computed between the rendered image and the baseline image. The plot of this error is 




[0055] 



As stated in Equation (4), the variance of an estimator is the integral of the 
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shown in FIG. 6D. The error decreases significantly up until about 2200, then levels off 
around M = 3500, although it continues decreasing slightly. 

A 

[0058] In one embodiment, ray samples of £2 are drawn according to H as 

illustrated with reference to FIG. 7. First, for each triangle in the visible list a normalized 

weight W ^ is computed as 
W 

^ T t visible^i 

which is the probability that a sample will be drawn from visible triangle T t . A map m: 
[0,1] x [0,1] is built, such that if x is uniformly distributed over [0,1] x [0,1], then 

A 

m(x) is distributed over Q with probability H , as illustrated in FIG. 7. Let M vis be the 

number of visible triangles. The interval [0,1] is divided into M vis non-overlapping 
subintervals S,- [a iy b^, such that the length of 5, 564 is W \. In one embodiment a 
function Idx(x) maps from a randomly selected point 562 in xe [0,1] to index i such that 
jce S,.. Idx can be efficiently implemented using, for example, a binary search. In addition 
a map function (Coord (i,x)) is defined as 

X — CL: 

Coord( i, x) = — 

b t - a t 

[0059] Finally, m is defined as m(w,v)= SphTri(T Idx(u)f Coord(Idx(u),u),v) where 

the SphTri function is an area-preserving map from the unit square to a spherical triangle 
T muy FIG. 7 is a schematic view of m, where Idx(u) = i,m(u,v)e T h and the value of 

A 

H(m(u,v)) is W/AreaiT^. In one embodiment, as illustrated with reference to FIG. 7, the 

subintervals of length S t 564 within a first unit square 560 are normalized relative to the 
unit square 570. Accordingly, the function m(u,v) maps from the unit square 570 to the 
hemisphere 586 according to the weight of each spherical triangle. 
[0060] In one embodiment, first, the index of a point 562 is determined based on 

which span S, its x coordinate lies in. The point is then mapped to the unit's square by 
normalizing its position within S, relative to unit square 570, via the coordinate function. 
Once normalized, the point is then mapped to the spherical triangle T t of sphere 630, as 
point 632 via the SphTri function. As such, in accordance with FIG. 7, an approximation 
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of H enables the ray samples to be uniformly distributed over the brightest light sources, 

for example, as depicted with reference to FIG. 5B. 

N 

[0061] In one embodiment, if jj^ } . =1 are random samples uniformly distributed 

over [0,1] x [0,1], an environment-based importance sampling estimator for the reflected 
radiance integral of Equation (1) with a Lambertian BRDF is, for example, 
. 1 1 L(m(Xj))(m(xj)-n)V p (m(Xj)) 

The per-hemispherical sample cost of this estimator is 0(log(M)), which the cost of the 
Idx function, so the overall cost of this estimator is 0(N(log(M)+A)), where A is the cost 
of evaluating V p . The per-pixel cost to generate the visible triangle list and compute the 
triangle weights is 0(M). 

[0062] While m has the desired sampling property, it is discontinuous and hence 

will destroy any stratification structure of the point set |jc . j. Despite this, points jjc .j 

generated using randomized QMC (R-QMC) sequences gives better results than 
independently drawn samples. One embodiment for coloring a point P with surface 
normal N using a Lambertian BRDF is depicted with reference to FIG. 8. 
[0063] In an alternative embodiment, a pixel-based decomposition could be used 

rather than the triangular decomposition of the hemisphere. In this embodiment 
precomputation is not required, but the technique is not as accurate. However, this 
embodiment is much simpler to implement. 

[0064] In one embodiment £[.,.] is a low-resolution version of the environment 

map, for example, as shown in FIG. 5A, with width w and height h (standard polar 
parameterization) with the positive 7-direction corresponding to the top row in E. For 
example, assume shading of a surface point p with normal n is performed. Given a pixel 
(ij) corresponding to direction co in the environment map, the probability of drawing a 
sample from that pixel is proportional to 

Prob{(/j)} = max(w*n,0) E[i,j] Area(i,j) 
where Area(iJ) is the area subtended by the pixel, which is estimated as 4n 2 sqrt(l- 
a) y )/w/z. In this embodiment, the formula is specific for a Lambertian BRDF. However, 
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in alternative embodiments, the max(coVz,0) could be replaced with any BRDF function of 
n,a>, and e (where e is the direction in which reflected radiance is being calculated): 
[0065] As depicted with reference to FIG- 9 

H[i,j] =/ r (G),n,e) ■ E[ij] - Area(iJ) (10) 
is computed for each pixel in E. Once computed, a sum over all pixels, S = is 
calculated. The probability of choosing pixel (ij) is equal to H(i,j)/S, and the value of the 
importance function over pixel (ij) is H(iJ)/(Area(iJ)S). Samples can be distributed over 
the hemisphere according to this importance function by using a map similar to m(u,v) 
function described above. From these building blocks, a standard importance sampling 
estimator is used with importance function H to estimate the reflected radiance, as 
depicted in process blocks 720-780 in FIG. 9. In this embodiment, H is a piecewise- 
constant importance function over the sphere. 

[0066] In a further embodiment, if there are other light sources in the environment 

with different importance functions for sampling, the light source can be combined in 
accordance with the embodiments described above using a balance heuristic. The 
balance heuristic is a technique for combining multiple importance sampling estimators 
into a single estimator. Furthermore, the visibility term (V p ) makes Equation (1) very 
difficult to solve because it makes the integrand discontinuous. However, there is 
coherence in the values of V p within a neighborhood of p. In one embodiment, a method 
of estimating A t (p) of Equations (6) and (7) takes advantage of this coherence. 
[0067] Furthermore, the visibility term (V p ) makes Equation (1) very difficult to 

solve because it makes the integrand discontinuous. However, there is coherence in the 
values of V p within a neighborhood of p. In one embodiment, a method of estimating 
A,(p) of Equations (6) and (7) takes advantage of this coherence. In one embodiment, 
whenever a hemispherical ray is cast (ray tracing) to determine occlusion, we note from 
which triangle T t in the fixed spherical tessellation the sample was taken, and record 
whether the ray was occluded or not. For each triangle T i9 we compute a denominator d t 
equal to the total number of rays cast through that triangle, and a numerator n, equal to the 
number of those rays that were unoccluded. In one embodiment, the values dj and n x are 
stored in a data structure such as a table, or a cache, referred to herein as a shadow cache. 
In one embodiment, the shadow cache values can be stored at a different angular 
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resolution than the fixed tessellation used in H , as long as there is a correspondence 
between the indices. 

[0068] As described herein, a complete set of values rc, and d i centered about a 

particular point are referred to as a cache item. In one embodiment, cache items are 
stored in a data structure, the shadow cache, or any other desired location. To compute 

A 

Alp), the shadow cache is searched for all cache items proximate to a point p and the 
sums of the items' numerators and denominators, on, and ad { are computed. If orf f is less 
than some threshold (we use 3), there is not enough information to make a good estimate, 

A A 

such that a value of 1 is used as the estimate Alp). Otherwise, on/ad I is used as Alp). 

A 

[0069] In one embodiment, the visibility value A t following defensive importance 

sampling, is remapped according to a turnable parameter oce [0,1], for example, 

aA i (p)^(l-a)(.5) 

A 

which prevents H from having an arbitrarily small tail distribution. In practice improved 
results were achieved with a value = .7. 

[0070] In one embodiment, contents of the shadow cache are pre-computed. In 

accordance with this embodiment, initially, several rays are cast into the scene from each 
surface point in order to build a data structure, such as a table (the shadow cache) that 
counts how many rays in a given direction are occluded or unoccluded. In one 
embodiment, a sampling algorithm uses this information to build the approximation of 
the hemispheric transfer function H. In an alternative embodiment, as depicted with 
reference to FIGS. 10A-10B, the initial casting of rays may be used to form a low- 
resolution block image 830, for example, as depicted with reference to FIG. 10C. 
[0071] In other words, as depicted with reference to FIG. 10A, several rays are 

cast from a point P 802 to determine occlusion. Initial casting of the rays results in a 
spherical image, depicted in FIG. 8B with a polar parameterization which illustrates 
occluded areas 822 and unoccluded areas 824 by ball 804. Based on this information, a 
low-resolution image 830 is formed. In one embodiment, occluded pixels are colored 
black, while unoccluded pixels are colored white. Likewise, partially occluded pixels 
may be colored gray. In accordance with this embodiment, the low resolution block 
image 830 may be stored as the shadow cache information. 
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[0072] Accordingly, using the image of occlusion 830, for a given pixel, and one 

or more nearby (proximate) pixels, in one embodiment, a linear blend may be performed 
to determine the visibility of the pixel. Accordingly, using a low-resolution image of 
occlusion 830, an approximation of the reflected radiance integral provides an estimate 
that is based on each of the elements of the reflected radiance integral (e.g., light source 
contribution, BRDF, and visibility). Moreover, by utilizing the low-resolution occlusion 
image, the amount of ray casting which is required to determine reflected radiance is 
drastically reduced by leading to faster convergence of the importance sampling 
estimator. 

[0073] FIG. 11 is a block diagram illustrating computer system 850, which 

includes render logic 900 for estimating reflected radiance under complex distant 
illumination, in accordance with one embodiment of the invention. Computer system 850 
comprises a processor system bus (front side bus (FSB)) 854 for communicating 
information between a processor (CPU) 854 and a chipset 860 coupled together via FSB 
854. As described herein, the term "chipset" is used in a manner well known to those 
skilled in the art to describe collectively the various devices coupled to the CPU to 
perform desired system functionality. 

[0074] Chipset 860 is also coupled to main memory 862 and one or more 

input/output (I/O) devices 890 (890-1, . . 890-N). In addition, hard disk drive devices 
(HDD) 870, as well as one or more I/O devices 890 (890-1, . . ., 890-N) are also coupled 
to chipset 860. In the embodiment illustrated, graphics device 880 is also coupled to 
chipset 860. In the embodiment illustrated, graphics device 880, such as a graphics card, 
includes render logic 900, which includes shade logic for generating a color value using 
an important sampling estimator for a reflected radiance integral. The importance 
sampling estimator selects a plurality of ray samples to generate the color value according 
to at least a light source term and a BRDF term of the reflected radiance integral, as 
described above. 

[0075] As illustrated in FIG. 12, render logic 900, provides shade logic 910 with 

a point P with surface normal N. In response, shade logic returns an intensity or color 

value for the point P. Shade logic 910 includes importance function logic 930, as well as 

ray sample logic 920, which are responsible for providing a reduced number of ray 

samples without compromising the quality of a final rendered image. In addition, in one 

embodiment, ray sample logic 920 performs sphere tessellation, as described with 
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references to FIGS. 6A-6C in order to identify and provide ray samples where light 
energy is most prevalent. 

[0076] Shade logic 910 may also include environment map logic 960 to store, for 

example, an environment map, such as described with reference to FIG. 5A. In addition, 
visibility logic 940 is provided to store, for example, a low resolution block image to 
determine visibility, as described with reference to FIGS. 10A-10C. In a further 
embodiment, BRDF convolution logic 950 is responsible for performing precomputation 
according to, for example, Equation (8), as described above. As such, using the various 
logic blocks, shade logic 910 utilizes color compute logic 970 to generate a color value 
using the importance sampling estimator as described, for example, with reference to 
Equation (9), as described above. 

[0077] Although reduced hemispherical sample estimation of the reflected 

radiance integral may incur overhead (evaluating at every pixel or triangle), the savings 
gained by the sampling deduction justifies the overhead. As a result of the reduced 
number of hemispherical samples, an accurate estimate of a reflected radiance value is 
generated with a reduced computation time. In one embodiment, a new importance 
sampling is used in order to estimate the reflected radiance integral. The new importance 
sampling algorithm converges faster than conventional BRDF-based importance 
sampling or lighting environment-based importance sampling because the importance 
function matches the integrand more closely. Also, the new importance function is 
efficient to evaluate and draw samples from, making it practical for use in a rendering 
package. Using this new technique, rendered images of an acceptable quality can be 
computed, for example, over 10 times faster than the previous best, exact techniques. 
Alternate Embodiments 

[0078] Several aspects of one implementation of the new importance sampling for 

providing reflected radiance have been described. However, various implementations of 

the estimation provide numerous features including, complementing, supplementing, 

and/or replacing the features described above. Features can be implemented as part of 

offline rendering part of the shading calculation in different embodiment 

implementations. In addition, the foregoing description, for purposes of explanation, 

used specific nomenclature to provide a thorough understanding of the embodiments of 

the invention. However, it will be apparent to one skilled in the art that the specific 

details are not required in order to practice the embodiments of the invention. 
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[0079] In addition, although an embodiment described herein is directed to a 

estimating reflected radiance under complex distant illumination, it will be appreciated by 
those skilled in the art that the embodiments of the present invention can be applied to 
other systems. In fact, systems for IBL based image rendering fall within the 
embodiments of the present invention, as defined by the appended claims. The 
embodiments described above were chosen and described in order to best explain the 
principles of the embodiments of the invention and its practical applications. These 
embodiments were chosen to thereby enable others skilled in the art to best utilize the 
invention and various embodiments with various modifications as are suited to the 
particular use contemplated. 

[0080] It is to be understood that even though numerous characteristics and 

advantages of various embodiments of the present invention have been set forth in the 
foregoing description, together with details of the structure and function of various 
embodiments of the invention, this disclosure is illustrative only. In some cases, certain 
subassemblies are only described in detail with one such embodiment. Nevertheless, it is 
recognized and intended that such subassemblies may be used in other embodiments of 
the invention. Changes may be made in detail, especially matters of structure and 
management of parts within the principles of the embodiments of the present invention to 
the full extent indicated by the broad general meaning of the terms in which the appended 
claims are expressed. 
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APPENDIX A 

Given a spherical triangle ABC defined by vertices A, B, and C, and a hemisphere 
centered about n, we want to compute whether the triangle overlaps the hemisphere, 
and if so, to describe the region of overlap. First, we test if the dot product of each vertex 
with n is positive or negative. Let t be the number of vertices with positive dot product. 

If t = 0, the triangle is fully outside the hemisphere. 

If t = 5, the triangle is fully inside the hemisphere. 

If t = 2, then the triangle partially overlaps and the intersection of ABC with £2 n 
can be described as the union of two spherical triangles. Let A be the vertex that such 
that A - n < 0. Let D be the point where the great arc that bounds £2 n intersects the great 
arc segment AB,D = Q n nAB. This is computed as D = ± x (A x 5), where the sign is 
chosen so that D lies between A and B. Similarly, let E = 3£2„nAC Then the two 
resulting triangles are BCD and CED. 

If t = 7, then the triangle partially overlaps £2„ is a single spherical triangle. Let A 
be the vertex such that A • n > 0. Define D and E as above. The resulting triangle is 
ADE. 
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